Multifunction remote control system for audio and video recording, capture, transmission and playback of full motion and still images

ABSTRACT

A multifunction remote controlled video recording, transmission and playback system includes a still frame generator adapted for selecting and generating still frames on the fly while a full motion video signal is being recorded, without interrupting the recording function. Audio and data signals, such as cockpit audio in an aircraft and gps and telemetry signals may also be incorporated in the recorded full motion video recording on a real time synchronized basis. The still frames are digitally enhanced, producing a full field frame from the analog video signal. Still frames can be produced in single, burst and snap modes without interrupting the full motion video recording function.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The invention is a continuation of co-pending patent application Ser.Nos.09/143,232, filed Aug. 28, 1998 “Multifunction Remote Control Systemfor Audio Recording, Capture, Transmission and Playback of Full Motionand Still Images,” and is assigned to the Assignee of the co-pendingapplication. The invention is generally related to audio and videorecording and playback systems for aircraft and is specifically directedto a single, multifunction control unit for recording, transmission andplayback of both audio and video signals.

2. Discussion of the Prior Art

Recording systems have been used on board aircraft for many years. Inthe military, many aircraft such as, by way of example, the U.S. NavyF-14 Tomcat, have included recorders that permit the pilot toselectively record video images by activating the recorder. Thesesystems also permit the images to be played back for viewing in acockpit monitor by the pilot while in flight or selectively, permittransmission of the images to a ship or ground station. The images aretypically input from a video sensing device located in the aircraft andalso controlled by the pilot.

Over the last several years a need has developed for better imagerecording, capture, playback and transmission techniques on board theseaircraft. The current systems, such as, by way of example, the TEACV1000 Video Tape Recorders (VTRs), only permit twenty minute or lessrecording capability and must be scrolled in order to find specificimages in the recording. Further, if a specific image is to be displayedas a still frame on the cockpit monitor, the recorder is stopped andlive images cannot be recorded by the video during this interruption.

It is also desirable that the recording system be expanded to includecockpit audio, telemetry signals, GPS (Global Positioning System)signals and other data signals available for monitoring the performanceof the aircraft and for increasing the amount of information associatedwith the video signals.

SUMMARY OF THE INVENTION

The multifunction remote control system of the subject invention isspecifically directed to an enhanced video recording, transmission andplayback system for aircraft. The system is capable of not onlyrecording, transmitting and playing back video images but is alsoadapted for recording, transmitting and playing back audio, telemetry,GPS and other data signal in synchronization with the video signal. Oneimportant unique feature of the invention is the incorporation of asingle, multifunction remote control unit for controlling all therecording, capture, transmission and playback functions at thefingertips of the pilot.

The system of the subject invention utilizes a digital image capturesystem capable of operating as a recorder and playback unit as well as atransmission system for transmitting full motion, selected still frameand combined full motion and still frame video images to an on boardmonitor or to a ship or shore station. One of the important features ofthe invention is the capability to capture and transmit a still image onthe fly while the recorder is still functioning. This is made possibleby incorporating a digital image capture device that receives andcaptures the images being entered on the recording medium withoutinterfering with the recording function. This also allows for betterquality still images by permitting the capture and transmission of afull frame video image instead of the partial frame, single field stillimages of the prior art.

In operation, the recorder may be paused in typical fashion in order toview a single frame. As with prior art systems, this will pause therecording function and the single still frame be a typical analog framewith a partial field image, often including the typical tearing which isa standard paused playback artifact. However, if the specific image isdesired to be captured and transmitted, the operator (or pilot) willselect the capture mode and the system will back up a preselected numberof frames and then forward through the selected still in order todigitally capture the selected image as a full frame image. Thiseliminates the fuzzy quality of single field images and eliminates thetearing, as well, resulting in a more reliable, sharper image formonitoring on site or for transmission to a remote location.

The system also permits on the fly capture of still frames withoutinterrupting the recording cycle. In both the record and pause modes andthe record and capture mode, the resulting captured signal is a sharp,full field (or full resolution) signal with a minimum of noise.

Another important feature of the invention is the capability for“marking” the recorded medium for later selecting, and capturingselected stills. During the recording mode, this marking functionpermits selection for later seek and capture either during laterplayback after completion of a mission, or during the mission directlyin the cockpit, using the cockpit monitor. When the media is in theplayback mode, the “marked” stills may be either automatically capturedand stored and/or transmitted as full frame digital stills, or thesystem may be used to manually scroll through the recording one-by-oneor automatically scroll through all of the selected, marked stills forsequential viewing/and or transmission. This capability is particularlyuseful for verification of visual data, such as, by way of example, thevisual verification of a target by a ship or shore station.

Another important feature of the invention is the automatic “reset”feature, where the beginning of each mission is marked on the recordingmedium and the counter point is noted or reset to zero. This permitsready identification of the beginning and end of each mission andpermits the operator or pilot to automatically return to the beginningof each mission to review the recorded images and data without searchingfor the start point.

The digital capture capability of the subject invention permitscontinuous real time recording of video and other data whilesimultaneously permitting the pilot or other operator to select a“freeze” frame, permitting close analysis of a specific view withoutinterrupting the recording process. The recorder/playback systems of theprior art require interruption of the recording process during afreeze-frame or pause mode. One important aspect of this feature is theability to not only view the select “freeze” frame, but also to capture,store and/or transmit the frame to a remote station.

The versatility of the system of the subject invention permitstransmission of the full motion image both in real time, or as a playedback recording, as well as still frames of selected images and burstmodes. The burst mode is a selection of sequential still images over aselected time frame. For example, assuming a target is identified anddestroyed, it may be desirable to select a sequential series of stillimages at specific timed intervals, e.g. every one-fourth of a second,for five seconds before and twenty seconds after destruction, while atthe same time simultaneously recording the full image on tape withoutinterruption. The burst mode is more fully described in my co-pendingapplication entitled: Video and Data Capture and Retrieval SurveillanceSystem for Aircraft, Ser. No. 08/729,139, filed on Oct. 11, 1996;Acoustic Catastrophic Detection and Data Capture and Retrieval Systemfor Aircraft; Ser. No. 08/738,487, filed on Oct. 28, 19961 and WirelessTransducer Data Capture and Retrieval System for Aircraft, Ser. No.08/745,536, filed on Nov. 12, 1996 and incorporated by reference herein.

One advantage of the system of the present invention is the capabilityfor recording not only video signals but also cockpit audio andtelemetry, GPS and other data signal as well, in a real time,synchronized relationship with the video image. The data signals aredisplayed in alphanumeric symbols with the video image in both the fullmotion and still frame mode. The audio portion is recorded for playbackand transmission in the full motion mode. The data signals can be usedas part of the marking function. For example, specific still frameimages could be selected based on GPS data for capture and storage, aswell as for transmission.

One of the most significant advantages of the subject invention is theinclusion of all the functional and operating controls in a singleremote control unit easily accessed by the pilot in the cockpit. Thispermits easy access and control of the system during flight, permittingfull use of the multifunction capability of the system. In the preferredembodiment, Phototelesis ATR-403WB and RCU-403 capture and transmissionmodules are combined with a TEAC HI 8 V80 VTR recorder/playback unit.This can be activated during both the recording mode and the playbackmode. These components are combined and programmed with the novelfeatures of the subject invention to provide the versatile,multifunction system. The single, multifunction remote control unit isthen utilized to not only control the recorder record and pause andplayback function but also to control the select, capture and transmitfunctions of the processor.

It is, therefore, an object and feature of the subject invention toprovide for a versatile, accessible, multifunction recording andplayback system for recording video images on board an aircraft duringflight.

It is also an object and feature of the subject invention to provide fora single, multifunction control unit for controlling all recording,selection and capturing, transmission and playback functions of thesystem.

It is another object and feature of the subject invention to provide fora combination video, audio and data recorder having a single remotecontrol unit for controlling all of the functions from a single controlunit.

It is yet another object and feature of the subject invention to providefor a multi-media recording, transmission and playback system which iscapable of selecting, displaying, storing and transmitting still fullfield still frame images without interruption of the real time recordingof full motion images.

It is also an object and feature of the subject invention to permitmarking of selected stills, bursts or sections of full motion imagesegments via operator controlled selection, or selection based onpredefined criteria such as time sequencing, GPS data or other.

Other objects and features of the invention will be readily apparentfrom the accompanying drawing and detailed description of the preferredembodiment.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an overview of some of the platform configurations for whichthe system of the subject invention is suited.

FIG. 2 is a system interface diagram.

FIG. 3 is a more detailed diagram of a system having the components asshown in FIG. 2.

FIG. 4 is an alternative embodiment incorporating an MIL-ST-1553 databus.

FIG. 5 is an alternative embodiment incorporating a platform computerassociated with the system of the subject invention.

FIG. 6 is a block diagram of central processing unit of the system.

FIG. 7 is a block diagram of the remote control unit of the system.

FIG. 8 is an enlarged view of the remote control unit shown in FIG. 2.

FIG. 9 is a menu flow chart for the system.

FIGS. 10 a, 10 b and 10 c are an expanded menu readout display, showingthe alphanumeric display for each of the menu selections of FIG. 9.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

A system overview is shown in FIG. 1. The system is adapted for use inany type of platform permitting not only the recording, capture,transmission and playback of video information, but also the mating ofdata signals and audio signal with the video information. The platformused as an example throughout this disclosure is a fixed wing militaryaircraft 1, such as, by way of example, the Navy F-14 Tomcat. Themulti-function system of the subject invention permits data to be usedon board the aircraft, as well as transmission and receipt of databetween a remote station such as a ship or ground based station 2.Images and data can be downlinked directly to the base station andconfiguration and control data and signals uplinked to the aircraft viaradio transmission. The system of the present invention alsoaccommodates air-to-air transmissions, as between the fixed wingaircraft 1 and the rotary winged aircraft 3, or air-to-seatransmissions, as between the fixed wing aircraft 1 and the marinevessel 4, or to ground as with the fixed winged aircraft 1 and themilitary vehicle 5 or the civilian vehicle 6. Any of a variety ofcombinations is possible. While the following description is directedprimarily to communication between fixed wing aircraft and a ship orground based system, it should be understood that the inventionencompasses any combination of base and object stations or units.

As shown in FIG. 2, the system of the subject invention comprises acentral processor unit 10, a recorder/playback unit 12, a base orinterface unit 14 and a multifunction, single remote control unit 16. Inthe preferred embodiment, the central processing unit 10 is aPhototelesis A72-403WB and the remote control unit 16 is a PhototelesisRCU-403WB. The recorder/playback unit 12 is a TEAC HI 8 V80 VTR system.The access door 18 provides access to the HI 8 V80 tape cassette whichis capable of up to two full hours of real time recording.

The remote control unit 16 is connected to the central processor 10 atconnector J10 via cable 20. Wireless remotes may also be incorporated inthe system without departing from the scope and spirit of the invention.A 28VDC power signal is provided via a cable connection at the J2connector in the interface unit 14. The monitor system 21 comprises the22 Lanterin Control Panel (optional), the PTID display 24 and the VDIdisplay 26. These are connected to the system via cable system 28 atconnector J4 in the interface unit. An ICS/DATA signal is connected viaconnector J3. The TCS video module 29, the video source, is connectedvia connector J5. The 28VDC power signal is transmitted from theinterface unit 14 to the central processor 10 via a cable system 30between connectors J7 and J13. Communication and control signals aretransmitted between the central processor and the interface unit viacables connected to connector J3 in the interface unit and connector J11and J12 in the processor unit. The main power switch is SW1 in theinterface unit. The recorder/playback unit 12 is connected to thecentral processor via a cable system 30 between connectors J1 and J2 onthe recorder playback unit, J15 on the Interface unit and connector J9on the processing unit 10. A signal light LED 1 is provided on thecentral processor to indicate that the processor is powered andoperational.

Once the system is powered up, all of the functions are controlled bythe single remote control unit 16 which includes a plurality of functionbuttons 32 and an alphanumeric display panel 34.

As shown in more detail in FIG. 3, the system of the subject inventionis adapted for interfacing with a telemetry and GPS data, as indicatedby the GPS receiver 40 and the aircraft interphone 42. In a standardapplication, the central processing unit can transmit and receive radiosignals from a ship, ground or other aircraft radio via antenna 44,radio link 46 and, where desired, an encryption unit 48.

The video switching module 50 is housed in the interface unit 14. SwitchA in the video switching module 50 permits selection between any of aplurality of video sensors such as video sensors A and B, as shown.These may be manually selected via the remote control unit 16, orprogrammed selection may be utilized as programmed at the centralprocessing unit 10. A controller module 52 receives the control andselection signal input on the data line 54 which is an RS-232 data lineconnected to data port 4 of the central processing unit. The processorvideo input select switch B is also provided in the video switchingmodule and is controlled by the controller 52 and selects the sensorsources or the recorder/player output forcapture/processing/storage/transmission. A display monitor input selectswitch C is also provided for selecting either the recorder/player unitoutput on line 56 or the processing unit output on line 58.

As shown in FIG. 3, the data signals from the GPS receiver and otherdata signal are introduced into the processor 10 for conditioning andinput for recording at the data/control port of the recorder/player 12and permit for digital storage, and transmission. This permits the datasignals to be recorded in simultaneous, real-time mode with the videosignals input from the video sensors A and B. The audio signal from theinterphone 42 is also input to the processor 10 and the recorder/playerunit 12 for real time, synchronized recording.

An optional high speed radio link 47, may also be provided to supportfull motion transmission capability and is linked to the high speedradio port of the processing unit 10 through the optional encryptionunit 49. The antenna 45 permits downlinking to a base station viawireless radio. This high speed full motion capability could beincorporated in any of the various configurations of the invention.Compression of the video signal with a compressor algorithm such as MPEG1 is desirable.

An alternative embodiment is shown in FIG. 4 and incorporates anMIL-STD-1553 data bus for connecting the display 21, the GPS and/orother data signal modules 40 and the radio and data controller 48 to thesystem. The radio interphone system 60 is also expanded to includeadditional audio channels. A VDU input matrix module 62 is provided forcontrolling the various video input signals to the cockpit integrateddisplay 21. This is controlled by the platform controller computer 70which is also connected to the display 21 and the processor unit 10 bythe MIL-STD-1553 data bus.

The 1553 bus is one common standard for interconnection of a pluralityof data devices on military airborne or ground platforms. It is theequivalent of a local area network (or LAN). Other networking devicescan be utilized without departing from the scope and spirit of theinvention. Many different sensors and data signal generators may beconnect to the 1553 bus, and data may be fused with imagery forrecording, digital storage or transmission. Examples of sensors that maybe utilized in connection with the subject invention and communicate andinteract of the 1553 bus are: GPS receivers, magnetic compass system,laser range finders, a time source, the aircraft altimeter, and FLIRdata, azimuth, range and location sensors. This greatly expands theversatility of the recording, capturing, transmission and playbackcapabilities of the system of the subject invention.

Data received by the 1553 bus may be processed and stored digitally withthe processing unit 10, or may be encoded and stored on therecorder/player unit 12, or both. This allows for the capture andretrieval of a wide variety of real time mission data in connection withthe mission video signals. The control of the processing unit 10 and therecorder/player unit 12 can be accomplished from the integrated VDU/keyunit and the platform control computer over the 1553 bus. Digital data,such as video, audio, telemetry data, control commands, and the like maybe communicated between the processing unit and the radio link (at 48)over the 1553 bus. In this manner, control commands can be transmittedfrom a remote station to the platform by using the common data linkavailable to the platform.

Another embodiment of the subject invention is shown if FIG. 5. In thisembodiment, the various components and data entry devices correspond tothose shown in FIGS. 3 and 4. However, a platform computer 70 has beenincorporated to illustrate the adaptability of the device to vehicleshaving a conventional PC (personal computer) or a platform specificcomputer capability. In this configuration, the multifunction system ofthe subject invention may be controlled via the platform computer. Videois displayed on the computer VDU 72 by digitizing the video and mergingit with the computer generated video in a display window. In addition, awindow is provided for the commands of the system, replacing the remotecontrol unit 16. The communication connection 78 between the processingunit 10 and the platform computer 70 may be an RS-232 cable, a LANconnection such as Ethernet MM-STD-1553, or any other datacommunications link. Other platform data, such as data from othersensors and computers, can be linked into the system from a LAN 76 orother direct communication connections. The computer keyboard 74 permitsdirect command and data entry into the platform computer. A mouse inputdevice or other similar input means could also be used.

A block diagram of the basic components of the central processing unit10 is shown in FIG. 6. A remote 28VPC power source is connected as shownin FIG. 2 and as indicated at 100. This is introduced into a DC/DCconvertor 102 for powering the cooling fan 104 and providing systempower at 106. When power is on, the pilot light LED 1 is illuminated.The heart of the processor 10 is a Pentium class CPU 108, which isconnected to a PCMCIA memory card 110, RAM memory 112 and ROM memory114, as well as the BIOS system 116 via an address bus 118 and a databus 120. The CPU 108 controls the PCMIA, RAM, ROM and BIOS componentsvia the control bus 122. The various components controlled by the CPU108 via the control bus for handling the flow of data and information onbus 124 are all interconnected via the bus 124, as shown. The audiointerface 126 permits communication with an analog radio interface andthe platform interphone system 42 (See FIG. 3). The synchronouscommunications interface 128 provides the communications link betweenthe CPU 108 and the digital encryption/radio interface 48 (also FIG. 3).An option 1553 bus interface 130 for use with the configuration shown inFIG. 4 is also provided. The RS-232 interface 132 providescommunications links to the various RS-232 devices such as the GPSreceiver 40, the remote control unit 16, the platform computer 70, thevideo switching module 50, and the like. The RS-422 interface 134 is thelink between the CPU 108 and the recorder/player component 12, otherinterfaces may be used. An optional LAN interface is also provided forsupporting, by way of example, a LAN interfaced platform computer 70 asshown in FIG. 5. Video display logic is provided at 138 for supporting aCRT/VDU display device 21. The video frame capture device 140 supportsthe capture function directly from the video sources such as sensors Aand B, thereby permitting video capture without interrupting therecorder 12. A “feature connector” interface allows full motion databetween the Video Frame Capture input and the Video Display Logic. Theoptional MPEG compressor 142 provides the high speed interface forsupporting full motion transmission via the high speed radio link 47(see FIG. 3).

A block diagram of the remote control unit 16 is shown in FIG. 7, theremote control unit. Is also powered by the platform power supply with a28VDC power signal as shown at 150. The power signal is introduced tothe DC/DC convertor 152 for providing system power at 14. The controlsignals from the system processor 10 are input and output on the RS-232line 156 via the respective receiver 158 and driver 160. These signalsare introduced into a microprocessor 162 via the serial input/outputport 164. The microprocessor system includes a FLASH-RAM 166, a RAM 168and a ROM 170, in communication with the microprocessor 162 via data bus172, address bus 174 and control bus 176. A data bus 178 links theparallel display bars LED 180 and LED 182 with the microprocessor, andalso links the various control buttons 32 with the microprocessor. Inthe preferred embodiment, the control buttons 32 are the input devicefor the system.

As better shown in FIG. 8 the control buttons 32 are dynamic functionbuttons located on the face of the remote control unit 16 in a rowunderneath the dual LED displays 180 and 182. The function of eachbutton is dynamic, i.e., the function changes based on the stat of thesystem and the user interface. The specific function is shown in the LEDrow and is positioned directly above the button. This method permitsmaximum versatility with a minimum number of buttons (Six in thepreferred embodiment).

The versatility of the system is demonstrated by the menu commandsutilized in the preferred embodiment, all accomplished with the sixdynamic control buttons on the remote control unit 16:

Recorder/Player Commands & Summaries:

Standby (STOP)

Record

Play

Rewind

Fast Forward

Forward Search

Reverse Search

Unthread

Reset Counter

Event Mark

Recorder/Player Statues (Message) Summary:

Standby

Recording

Play

Rewind

Fast Forward

Scan Forward

Scan Reverse

Unthread

Counter (Hours:Minutes:Seconds)

End of Tape (EOM)

Beginning of Tape (BOT)

Internal Error

Command Error

Communications Error

Event Mark

Dew (Condensation)

Image Store/Transmission Command Summary:

Send

Send and Delete

Set Send-to Call Sign

Set Local Call Sign

Capture

Capture & Send

Set SNAP/BURST Mode

Set Burst number

Set Burst Interval

Review Image Buffer

Scroll Forward

Scroll Reverse

Mark Image

Delete Image

Purge Buffer

Find Mark & Capture

Find Mark Capture and Send

Find All Marks & Capture

Find All Marks Capture & Send

Communications Abort

Select Input “N”

View Recorder

View Input

View Processor

Select Compression

Set Resolution

Input Type (S-video, composite, other)

Image Store/Transmission Summary:

Sending to “XXXXX”

Receiving from “YYYYY”

Communications Error

A flow chart of the menu capability is shown in FIG. 9, initiating atMain Menu 200. Each of the selections 15 accessed by activating thevarious dynamic button switches 32 (See FIGS. 2, 3 and 8). As indicatedby the flow chart, the menu is scrolled through with the display shownin the parallel display bars LED 180 and LED 182 (FIG. 8). A moredetailed menu/display correlation is shown in FIGS. 10 a, 10 b and 10 c.Beginning at the Top Level Menu 202, reflecting the recorder state, thetop display 180 shows various counter functions and the bottom display182 illustrates the button function of the button switch 32 immediatelybelow the display panel. As shown, the top level first position is theRecord menu 204, the Play menu 206, the Standby menu 208 and theUnthread menu 210. This same display regimen is followed for each of theother Menu Levels which are activated as indicated in the drawing.

While certain features and embodiments of the invention have beendescribed in detail herein it will be readily understood that theinvention encompasses all of modifications, enhancements andimprovements within the scope of the following claims.

1. A multifunction remote controlled recording/playback system forrecording full motion video signals comprising a series of sequential“still” frames, the recording/playback system comprising: a. arecorder/player; b. a central processing unit for controlling therecording/playback system; c. a video signal source for providing avideo signal; d. a video signal display monitor; e. a video signaltransmission system; f. a video signal switching system responsive tocommands from the central processor unit for selectively distributingthe video signal to the recorder/player, the display monitor and thetransmission system, wherein a full motion video signal may bedistributed to the recorder/player while a selected still frame of thevideo signal is distributed to other components of the system.
 2. Themultifunction remote controlled recording/playback system of claim 1,further comprising a digital capture system for creating a still frameon the fly as the full motion video signal is generated by the videosignal source, whereby a full field still frame is produced.
 3. Themultifunction remote controlled recording/playback system of claim 1,further comprising means for capturing a selected group of sequentialstill frames on the fly as the full motion video signal is generated bythe video signal source.
 4. The multifunction remote controlledrecording/playback system of claim 1, wherein the video signaltransmission system is adapted for transmitting full motion videosignals in a first mode as the full motion video signal is generated bythe video signal source and in a second mode as a playback of therecorded full motion video signal from the recorder/player.
 5. Themultifunction remote controlled recording/playback system of claim 1,further including an audio signal generator for generating an audiosignal which can be recorded by the recorder/player in real timesynchronization with the full motion video signal.
 6. The multifunctionremote controlled recording/playback system of claim 1, furtherincluding a data signal generator for generating a data signal which canbe recorded by the recorder/player in real time synchronization with thefull motion video signal.
 7. The multifunction remote controlledrecording/playback system of claim 6, wherein the data signal generatoris a gps signal generator.
 8. The multifunction remote controlledrecording/playback system of claim 1, further including a marking signalgenerator, whereby specific, selected still frames of the recorded fullmotion video signal may be marked, the system being adapted to selectsaid frames by searching for the marks, for distribution of the recordedmarked frames by the video switching system.
 9. The multifunction remotecontrolled recording/playback system of claim 8, wherein the markingsignal generator is operative in a plurality of modes, a first modebeing manually activated by an operator and a second mode beingactivated by a preselected data signal.
 10. The multifunction remotecontrolled recording/playback system of claim 1, wherein the centralprocessing unit is a Pentium class processor.